Unfortunately, there is no possibility at the moment to have a job allowed to fail, while having the green arrow for the tests. So I propose to split this PR, and we will merge the CI part once this is resolved actions/runner#2347

@chrisburr any idea why all the PRs have issues starting all the tests lately ? Do we reach a quota or something ?

There isn't a quota for public projects.

I think it's just instability on the GitHub side with an API call getting lost somewhere. The uptime shown on their status page isn't great and has been getting worse over the last few months. I've opened a support ticket about it.

Yeah I did check the status page but since it was green for the days we had issues, I assumed it was something else...

I got an impressively quick response:

Ahh sorry about that -- this was a recent issue that our engineers just shipped a fix for a few hours ago. The symptoms match the runs you shared where the run reports as completed (in the UI under the Actions tab and in the API), but it has jobs reporting as queued.
I see the most recent example you shared is from ~15 hours ago, so before the fix went out. Can you let us know if you see any new runs that demonstrate this behavior?

And indeed, the actions overview shows the run as completed even if the detailed page doesn't. If anyone sees it happen again let me know and I'll continue the thread.

The comment in the op should be adapted. Anyway the main question is: do you still need to add something?

Ready to go

There are a few more places in the tests where --cfg can be added, e.g.:

• https://github.com/DIRACGrid/DIRAC/blob/integration/tests/Jenkins/utilities.sh#L401
• In this function: https://github.com/DIRACGrid/DIRAC/blob/integration/tests/Jenkins/utilities.sh#L1021
• In Test_TimeLeft.sh

Would you mind adding it there too?

No problem.
For https://github.com/DIRACGrid/DIRAC/blob/integration/tests/Jenkins/utilities.sh#L401 it's a bit strange though that the configuration file is is passed twice

No problem.
For https://github.com/DIRACGrid/DIRAC/blob/integration/tests/Jenkins/utilities.sh#L401 it's a bit strange though that the configuration file is is passed twice

The second (with "-F" is the file to update.